The von Mises Graphical Model: Expectation Propagation for Inference (CMU-CS-11-130/CMU-CB-11-102)
نویسندگان
چکیده
The von Mises model encodes a multivariate circular distribution as an undirected probabilistic graphical model. Presently, the only algorithm for performing inference in the model is Gibbs sampling, which becomes inefficient for large graphs. To address this issue, we introduce an Expectation Propagation based algorithm for performing inference in the von Mises graphical model. Our approach introduces a moment-matching technique for trigonometric functions to approximate the Expectation Propagation messages efficiently. We show that our algorithm has better speed of convergence and similar accuracy compared to Gibbs sampling, on synthetic data as well as real-world data from protein structures. This research was supported by NSF IIS-0905193. Corresponding Author: [email protected]
منابع مشابه
The von Mises Graphical Model: Structure Learning (CMU-CS-11-108 / CMU-CB-11-100)
The von Mises distribution is a continuous probability distribution on the circle used in directional statistics. In this paper, we introduce the undirected von Mises Graphical model and present an algorithm for structure learning using L1 regularization. We show that the learning algorithm is both consistent and efficient. We also introduce a simple inference algorithm based on Gibbs sampling....
متن کاملThe von Mises Graphical Model: Regularized Structure and Parameter Learning (CMU-CS-11-129/CMU-CB-11-101)
The von Mises distribution is a continuous probability distribution on the circle used in directional statistics. In this paper, we introduce the undirected von Mises Graphical model and present an algorithm for parameter and structure learning using L1 regularization. We show that the learning algorithm is both consistent and statistically efficient. Additionally, we introduce a simple inferen...
متن کاملThe von Mises Graphical Model: Expectation Propagation for Inference
The von Mises model encodes a multivariate circular distribution as an undirected probabilistic graphical model. Presently, the only algorithm for performing inference in the model is Gibbs sampling, which becomes inefficient for large graphs. To address this issue, we introduce an Expectation Propagation based algorithm for performing inference in the von Mises graphical model. Our approach in...
متن کاملContinuous Graphical Models for Static and Dynamic Distributions: Application to Structural Biology
Generative models of protein structure enable researchers to predict the behavior of proteins under different conditions. Continuous graphical models are powerful and efficient tools for modeling static and dynamic distributions, which can be used for learning generative models of molecular dynamics. In this thesis, we develop new and improved continuous graphical models, to be used in modeling...
متن کاملThe von Mises Graphical Model: Structure Learning
The von Mises distribution is a continuous probability distribution on the circle used in directional statistics. In this paper, we introduce the undirected von Mises Graphical model and present an algorithm for structure learning using L1 regularization. We show that the learning algorithm is both consistent and efficient. We also introduce a simple inference algorithm based on Gibbs sampling....
متن کامل